Mashhad R. J. Math. Sci., Vol. 2(1)(2009) 27-42 


A sufficient condition for null controllability of 


nonlinear control systems* 


A. Heydari'(&) 

Department of Applied Mathematics, Payamnoor University, Fariman, Iran 
A.V. Kamyad 

Department of Applied Mathematics, Ferdowsi University of Mashhad, Iran 


Abstract 


Classical control methods such as Pontryagin Maximum Principle and Bang- 
Bang Principle and other methods are not usually useful for solving opti- 
mal control systems (OCS) specially optimal control of nonlinear systems 
(OCNS). In this paper, we introduce a new approach for solving OCNS 
by using some combination of atomic measures. We define a criterion for 
controllability of lumped nonlinear control systems and when the system is 
nearly null controllable, we determine controls and states. Finally we use 


this criterion to solve some numerical examples. 
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1 Introduction 


We consider a nonlinear time-variant system as follows: 


& = g(t, x(t), u(t), WEE J, (1) 
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a(to) = 0, u(ty) = xy, (2) 
where Q] = J x Ax U x D, here J is a known closed interval [to,t;], A and 
D are compact and peicewise connected sets in R” such that a(t) € A and 
a(t) € D,Vt € J, and U is a compact set in R™ such that u(t) € U,Vt € J, and 
g is continuous on J. If there are u(.) and x(.) that satisfy equation (1)-(2) we 
call the system is controllable. 

In the following, by means of a process of embedding and using measure the- 
ory, this problem is replaced by another one in the space of Borel measures, that 
we seek to minimize to a linear form over a compact subset of the measure space. 
The theory allows us to convert the new problem to an infinite-dimensional lin- 
ear programming problem. Later on the infinite-dimensional linear programming 
problem is approximated by a finite dimensional one. Then by the solution of 
the linear programming problem one can find approximate functions for states 
z(-) and control u(-). 

If the system has an objective function we can use this process for solving the 
systems defined by multi-objective control systems. 

There are some literature on nonlinear optimal control for lumped and dis- 


tributed parameter systems, see for example, {2]—[12]. 


2 Defining the problem 
Let us define in (1), for all t in J = [to, ty] 
y(t) = a(t), (3) 
Then the equations can be rewritten as 
y(t) = g(t, a(t), u(t), (4) 


(to) = to, (ty) = ay. (5) 


Now we define the function h: 0, — Ras 


h(t, o(t), u(t), y(4)) = lly(t) — g(t, w(4), u()) II, (6) 
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and let the functional I(., 7(.), u(.), y(.)) be as follows: 


I(.,2(.),u(.),y()) 4 [ h(t,c(t), u(t), y(t))dt. 


Now, we investigate a necessary and sufficient condition for controllability of con- 


trol system (1)-(2). 


Theorem 1. A necessary and sufficient condition for controllability of control 
system (1)-(2) is 

Min I[(-,-,-,-) =0, 
that is equation (1) and boundary conditions (2) are valid on Qy. 


Proof. Since h > 0 and it is continuous, h is Rimman integrable. If 
Min I(-,-,-,-) =9, 


u*(.) and x*(.) are the corresponding control and trajectory and «(to) = to, x(t) = 


xy, then 
| h(t, @* (t), u*(t), y* (t))dt = 0 
Z 

and we will have h = 0. So 

y"(t) = g(t,a"(t), u(t), 
or 

&*(t) = g(t,2*(t), u*(t)). 
In other words, in this case u*(.) and «x*(.) satisfy equations (1)-(2) and the 
system will be controllable. 


Conversely, if the system is controllable; that is, if (1)-(2) are satisfied, then 
h =0, for allt in J. So 


[mee.2(0).u(e)-u(oae =0 


and then I(.,z,u,y) =0, hence Min I(.,z,u,y) = 0. 
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Note In practice we usually obtain suboptimal solution for [(.,.,.,.) in The- 
orem 1, that is we have many errors for controllability of the system, for example 
computational errors. So usually Jis not exactly equal to zero, in this case let the 


total permissible errors be at most € > 0, where ¢€ is a known positive number. If 


e(t) © lly*(t) — 9(t,2*(t),u*(0))Ilbe = ( i ly*(t) — glt,2*(t), ut ())|Pat)"”2 (7) 
and e < e, then the system is almost controllable, so we define fuzzy controlla- 


bility. 


Fuzzy controllability Let C be the fuzzy set of permissible controls and tra- 


jectories as follows: 
OC & {(2,u,y) :C(a,u,y) is as follows} 


(«=e) 
C(z,u,y) = : 
0 , otherwise. 


,E<E 


Then we say the system is controllable of grade C. 


Controllability of multi-objective systems 


Let our Multi-Objectives System be the minimization of 


Eisa(t) a). 6) = [ fat 2(0). ul. 2(0)at 4=1,2,-:- ,k, 


subject to the conditions (1)-(2), also we would like to be sure that our system 
is controllable or fuzzy controllable. 


If we consider y(t) as before and 
w(t) = (wi (t), we(t),--> , weer(t)) 
such that 


w(t) € E, where Ec R**! and E = [0,1] x [0,1] x --- x [0,1], 
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and also we define an objective function which is a convex combination of the 


above objectives, that is, we assume the weights for objectives, as follows: 


k 
Ho) & Yanlt) / falt, (4), u(t), ylt))dt-+w 441) (f) [ h(t, «(t), u(t), y(t))ae, 
k+1 
So u(t) =1, O< w(t) <1, 1=1,2,..,k4+1, 
i=1 


and we consider f in the following way 


k 
F(t, a(t), u(t), y(t), w(t) = >) wilt) fil. 2,4, y) + WE (AC, 2,49); 


t=1 


then I(.,.,.,.,.) will be 


I(..2, 14, y,w) i f(t, 0(t), u(t), y(t),w(t))ae, 


then the minimization of I(.,2,u,y,w) will be a criterion for controllability and 
also multi-objective performances functional. In the special case, when w;(t) = 


0, 7=1,2,...,k and w~41)(t) = 1, it is just a criterion for controllability. 


3 Metamorphism 

We define [(-), u(-), y(-)] to be an admissible triple, provided for all ¢ in J, 
e the function z(-) is continuous, and z(t) € A; 
e the function z(-) is continuous, and y(t) € D; 
e the function u(-) is Lebesgue measurable, and u(t) € U; 


e the triple satisfies the system of differential equations (4)-(5) and a.e. on 


J° = (to, ty) in the sense of Caratheodory. 


We denote the set of admissible triples by V. The problem has no solution unless 


VO. 
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Using the above assumption, the problem is now as follows: 


Find an optimal admissible triple v € V which minimizes the functional 


Deacipssy) = F(t, z(t), u(t), y(t), w(t) dt. (8) 


Assume that B is an open ball in R’*! containing J x A, denote the space of all 


differentiable functions on B by C’(B), and for ¢ € C’(B) define 


pi (t, ©, u,y) = dz (t,x).g + d(t, 2), (9) 


where $(-) and g(-) are n-vectors and the first term in the right-hand side of (9) is 
an inner product and ¢9 is in the space C(Q) of real-valued continuous functions 
defined on the compact set Q, where Q = Q; x E. Then by the definitions of g 


and ¢ and using the chain rule we have 
[ otte2(0).ult). vitae = f 6¢t,2(e))at 
J J 


= p(t, x(tr)) — d(to, z(to)) = d¢. 
Therefore 
[ eee u(t), y(t))dt = 6¢,V¢ € C'(B). (10) 
Since A may have an empty interior in R”, we need to introduce the set B and 
space C’(B). Suppose D(J°), is the space of infinitely differentiable real valued 


functions with compact support in J° and each « and g have n components such 


as a; and gj,j =1,2,...,n. For each ~ € D(J°), define 
If w is an admissible pair, then for any ~ € D(J°) we have 


[vite .uey.ulonae =f eso'@aes f arocnar 


= nj(ty(t) [hf {et — gilt.2(0), ul) (Det 
J 


Since 7 has compact support on J°, it follows that 


(to) = Y(ty) = 9, 
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and hence 
| voteet u(t), y(t))dt = 0. (12) 


Now, we choose those functions in C’(B) which depend on the time variable only 


and denote this subspace by C) (2). Set 


B(t, x, u, Y; w) = B(t), (t, x, U, y) = 2. 


Thus 
[ arte.2(.u(0).u(e)at = 49,8 € C(O), 


where ag is the Lebegue integral of A(t, x, u, y) on J. 

In a given classical problem, the set of admissible triples is fixed. If we add 
some elements to it, we have changed the problem and considered a new one, 
inspired classically, but a different formulation nevertheless. 


Consider the mapping 
Aw: FE C(O) > [ P(tx(t), u(t), v(t), w(t 
J 


which is a linear and positive functional. Let us rewrite (8) subject to the condi- 


tions (4)-(5) in the new representation as follows: 
Minimize A,(f) (13) 
subject to 
Ay($*) = 59, ¢ € C'(B) 
Agta) = 0.9 = 1, 2c ie DiI) (14) 


Ay(B) = ag, B € Ci (Q). 


We mention that A, is a positive Radon measure on the set C(Q). We denote 
the space of all positive Radon measures on Q by M*t(Q). A Radon measure on 


Q can be identified with a regular Borel measure on this set (see [13], Riesz 
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Representation Theorem). Thus, for a given positive functional on C(Q), there 


is a positive Borel measure on 2 such that 


A(F) =f Pau = nF). 


Now, the problem (13)-(14) can be replaced by a new problem as follows. We 


seek a measure in M*(Q) which minimizes the functional 
wEMT(Q)>u(f)ER (15) 
and satisfies the following constraints: 
($9) = 66, 6 € C'(B) 


Lj) = 0,7 = 1,2,...,n;% € D(J*) (16) 
u(B) =ag,8 € Cy(Q). 


Thus, we consider the extension of our problem: Minimization of (15) over the set 
Q of all positive Radon measures on 22 satisfying (16). Considering such measure 


theoretic form of the problem has teo main adventages, namely 


e The existence of an optimal measure in the set Q, which satisfies (16) can be 
studied in a straightforward manner without having to impose conditions 


such as convexity, which may be artificial. 


By the Proposition II.1, Theorem II.1 and Proposition II.3 of [14], we are able to 


prove the existence of the optimal measure. 


4 First approximation 


The problem (15)-(16) is an infinite dimensional linear programming(LP) prob- 
lem, because all the functionals in (15)-(16) are linear in the variable py even if 


the original problem is nonlinear and furthermore, the measure jz is required to 
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be positive. Of course, (15)-(16) is an infinite dimensional LP problem, because 
M*(Q) is an infinite dimensional space. It is possible to approximate the solu- 
tion of this problem by the solution of a finite-dimensional LP of sufficiently large 
dimension. Also, from the solution of this new finite dimensional LP we induce 
an approximated admissible triple in a suitable manner. We shall first develop an 
intermediate problem, still infinite-dimensional, by considering the minimization 
(15), not over the set Q but over a subset of M*(Q) defined by requiring that 
only a finite number of the constraints in (16) are satisfied. This will be achieved 
by choosing countable sets of functions whose linear combinations are dense in 
the set Q, and then selecting a finite number of them. Consider the first set 
of equalities in (16). Let the set {¢;,2 = 1,2,...} be such that the linear com- 
binations of the functions ¢; € C’(B) are uniformly dense. For instance, these 
functions can be taken to be monomials in the components of the n-vectors « and 
variable t. 
Now, we consider the functions in D(J°) defined as below 


2ar(t = to) 
ot 


2ar(t = to) 


1 = 
iP cos| 7 


sin| IPE ce ieee ‘ave 


where dt = ty — to, if ys are chosen as (17), and the sequence {x ,},/ = 1,2,... is 
of type ~; in (11). Then the first approximation will be completed by using the 
above subjects and Proposition III.1 of [14]. 


5 Second approximation 


By Proposition III.2 of [14] the optimal measure has the form 


N 
w= So of d(zf), (18) 
kei. 


where z; € Q and aj; > 0,k = 1,2,...,N, where 6(-) is unitary atomic measure 


with the support being the singleton set {z,}, characterized by 


5(z)(F) = F(z),z € 2. 
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This structural result points the way towards a nonlinear problem in which 
the unknowns are the coefficients aj, and supports {z;},k = 1,2,...,.N. 

To change this problem to a LP problem, we use another approximation. 
If w’ is a countable dense subset of 2, we can approximate p* by a measure 


v € M*(Q) such that 
N 
nS S- aj.5 (zn), 
k=1 


where z, € w% = {21, 22,...,2n }(Proposition III.3 of [14]). 
This result suggests the following LP problem 
Given € > 0 and 2; € i = 1D. we Ne 


N 
Minimize De aj f(z) (19) 
= 


subject to 


N 
| So 0569 (2) — bbs |S 6 =1,2,---, Mi, 


j=l 
N 

| do agxi(zy) |S 61 = 1,2,..., Ma, (20) 
j=l 
N 

| S| a58s(25) — ag, |<e,s=1,2,--- ,D, 

j=l 


a; >0,j =1,2,...,.N. 


Assume P(M), M2,L)* in R™ is defined by a; > 0,j = 1,2,...,N satisfies (20), 
then by Theorem III.1 of [14], for every « > 0 the problem of minimizing the 
functional (19) on the set P(M,, Mo, L)* has a solution for N = N(e) sufficiently 


large, and the solution satisfies 
N 
n(Mi, Mz, L) + ple) < >) ag f(z) < n(Mi, Mo, L) +, 
j=l 


where p(e) > 0 ase 0. 
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Let 6, € C1 (Q), 
6,.(t, x, U, y, W) Sia = 0, L jeg (21) 
then the set of 6,’s is dense in C)(Q). Assume that there are a number L of them 
in the set {2}. It is necessary to choose L number of functions of the time 


only, to replace the functions 6,,r = 0,1,... which were not found suitable, so we 


have chosen some suitable functions, to be denoted by f,, s = 1,2,...L, as follows: 


1 ifte J, 
f(t) = 


0 otherwise, 


where J, = (to + (s—1)d, to + sd), d = % Since every continuous function can be 


written as a linear combination of monomials of type 1,2, x,.... We assume 
Pi = 21, pe FS LQ, ores Pn =n; 


2 2 2 
Ont = £1", ¢On42 = £2°,..., Pan = Fn", 


until Mj, functions are chosen, also assume 


2 =, 
Gy Seine ay cs 
ot 
or 
2ar(t = to) 


wv" (t) = 1 —-cos| re lr = Moai + 1, Ma; + 2,...,2Mo1, 
where x , are chosen as ~ in (11), then we have My = 2nMo2, number of type 
Xo 
Now, if in the problem (19)-(20), € > 0 and z; € w’,j = 1,2,...,N, then we 
have 
N 
Minimize Ss a; f (25) (22) 
j=l 


subject to 


N 
S > G9 (23) = 66,4 = 1,2,-++ , Mi, 
j=l 
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N 

S > ay fs(z5) = gh = 162 sch: 
j=l 
a 50,9 21, Dee 


where a, is the integral of f, on J. By solving this finite dimensional LP problem 


we obtain the nearly optimal a*’s. 


6 Numerical examples 


Example 1. Consider the nonlinear time-variant problem 


& = a sin(x)+u 


We let € = 0.1 and partition respectively the sets J = [0,1], A = [0,0.5], D = [0,1], 


and U = [0,1] into p, = pa = pp = py = 10 and M, = 6, M2 = 4, and L = 10. 


| 0.6 
0.4 
SOs = 
0.2 
0 0 
0 0.5 | 0 0.5 | 
Optimal Control State 


We used Revised Simplex method to solve such problem and found f* = 0.0065, 
x*(0) = 0 and x*(1) = 0.4995, and degree of controllability of this example is 
C = 0.9349. Below, the figures of x(-) and u(-) are given. 


Example 2. Consider the nonlinear time-variant optimal control problem 


al 
Minimize ¢ u? (t)dt, 
0 
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subject to the conditions 


Then 


h(t, 2(t), u(t), y(t) = lly(t) — (w*sin(x) +4)||, Wee J 


and 


We let wi(t) = wo(t) = 4 and € = 0.1 and divide respectively the sets J = 
[0,1], A = [0,0.5], D = [0,1], and U = [0,1] into p = pa = pp = py = 10 and 
M, = 6, M2 = 4, and L = 10. 


We used Revised Simplex method to solve this problem and found f* = 0.1138, 
x*(0) = 0 and z*(1) = 0.4981. Below, the figures of x(-) and u(-) are given. 


0.5 0.6 
0.4 
= 0.45 = 
0.2 
0.4 0 
0 0.5 | 0 0.5 | 
Optimal Control State 


Example 3 (A system of coupled hydraulic tanks [1]) A state-space model 
can be set up with the inlet flow-rate u as input, the depths of liquid (21, x2) 
in the respective tanks as state variables and the output taken as x2, since the 
objective is to control the level in tank2. With tanks of the same dimensions, and 


orifices of equal size, the state-space equations expressed in suitably normalized 
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variables become 


fy =uU— V2 — Xa, 
Ly = fx, — Lo — V2, 
where it is understood that the system operates only in the region 
£1 > x2 >0. 


We assume € = 0.1 and divide respectively the sets J = [0,0.5], Al = [0.05, 0.45], D1 = 
(0.05, 0.45], A2 = (0.05, 0.35], D2 = [0.05,0.35], and U = [0,1] into p = pa, = 


PD, =PAy = PD, = Pu = 4 and M, = 2, M2 = 8, and L=4. 

We solve this problem and found f* = 0.0465, «j(0) = 0.02,27 (0.5) = 
0.1214, 23 (0) = 0.02 and #3(0.5) = 0.0902, and degree of controllability of this 
example is C' = 0.5355. Below, the figures of u(-), x1 (-), and x2(-) are given. 


“0 0.1 0.2 0.3 0.4 0.5 
Optimal Control 

0.1 0.15 

0.1 
ey 0.05 = 
> > 

0.05 

0 0 

0 0.5 0 0.5 


State2 Statel 
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